When performing tasks like automatic speech recognition or spoken language understanding for a given utterance, access to preceding text or audio provides contextual information can improve performance. Considering the recent advances in generative large language models (LLM), we hypothesize that an LLM could generate useful context information using the preceding text. With appropriate prompts, LLM could generate a prediction of the next sentence or abstractive text like titles or topics. In this paper, we study the use of LLM-generated context information and propose an approach to distill the generated information during fine-tuning of self-supervised speech models, which we refer to as generative context-aware fine-tuning. This approach allows the fine-tuned model to make improved predictions without access to the true surrounding segments or to the LLM at inference time, while requiring only a very small additional context module. We evaluate the proposed approach using the SLUE and Libri-light benchmarks for several downstream tasks: automatic speech recognition, named entity recognition, and sentiment analysis. The results show that generative context-aware fine-tuning outperforms a context injection fine-tuning approach that accesses the ground-truth previous text, and is competitive with a generative context injection fine-tuning approach that requires the LLM at inference time.

It's common knowledge that Barack Obama met the woman who eventually became his wife, Michelle Robinson, when he came to work at her law firm as a summer associate. George W. Bush met the future Mrs. Bush, who was Laura Welch back then, at a barbecue and took her mini-golfing the next day. And we all remember that Bill and Hillary Clinton were law school sweethearts. The historical record is full of these president-and-first-lady origin stories: Harry Truman was just 6 when he met the woman he would go on to marry, in church. So it's only natural to ask how the current crop of presidential candidates' how-they-met stories stack up.

While much of the automotive world is focused on the New York Auto Show, a small car startup has unveiled its first-ever vehicles on the other side of the country in Santa Clara, California. SF Motors, the US arm of Chinese company Sokon, has just announced two cars -- the SF5 and the SF7 -- as part of a whole new line of electric vehicles. The SF5 is a medium size crossover SUV, and the SF7 is a full size crossover. The SF5 will be available for pre-order by the end of this year and will ship in 2019. Both vehicles boast a proprietary powertrain that promises 1,000 horsepower and the ability to accelerate to 60 miles per hour in under 3 seconds.